Dynamic survey based on time stamping

ABSTRACT

A hosting server streams a media item to a participant device, and receives from the participant device time-stamp information indicating an interaction time associated with a participant interaction with the media item. In response to receiving the time-stamp information, the hosting server determines, from the time-stamp information, a consumed portion of the media item. The consumed portion of the media item corresponds to a portion of the media item streamed to the participant device prior to the interaction time. A determination is made, based on the consumed portion of the media item, whether to transmit survey content to the participant device. In response to determining that survey content is to be presented, the survey content is transmitted to the participant device.

CROSS-REFERENCE TO RELATED APPLICATIONS

The present U.S. Utility Patent Application claims priority pursuant to35 U.S.C. § 120 as a continuation of U.S. Utility application Ser. No.14/707,405, entitled “LISTENER SURVEY TOOL WITH TIME STAMPING”, filedMay 8, 2015, scheduled to issue as U.S. Pat. No. 10,089,643 on Oct. 2,2018, which is a continuation of U.S. Utility application Ser. No.13/031,511, entitled, “LISTENER SURVEY TOOL WITH TIME STAMPING,” filedFeb. 21, 2011, issued as U.S. Pat. No. 9,117,198 on Aug. 25, 2015, whichclaims priority pursuant to 35 U.S.C. § 119(e) to U.S. ProvisionalApplication No. 61/306,739, entitled “LISTENER SURVEY TOOL WITH TIMESTAMPING,” filed Feb. 22, 2010, all of which are hereby incorporatedherein by reference in their entirety and made part of the present U.S.Utility Patent Application for all purposes.

FIELD OF INVENTION

The present disclosure relates in general to automated surveys, and moreparticularly to dynamically presenting surveys based on Time Stamping.

BACKGROUND

Conventional software for media surveys may be generally centered aroundmusic hooks and basic questions. But such media surveys may not becompelling, engaging, and present a user-friendly interface that willkeep clients participating more often, and create a better bond with theclient. Conventional survey systems generally do not allow clients toconduct surveys using an all in one project. For example, Radio Face-Offand AMT is are separate tools, that do not provide an All-In-Onesolution for clients.

SUMMARY

Various embodiments of the present disclosure allow the formation of asystem or method to provide feedback regarding a user's perceptionregarding a particular feature, content, or questions presented in asurvey.

In one aspect of the disclosure, media is displayed on a remotelylocated end-user device and user interaction with the media is monitoredvia a computer, which also records a time-stamp that is based on theuser interaction with the media. A survey based on the time stamp isdisplayed on the end-user device.

The media can include one or more of the following: audio, video, andwebsite content. One or more of the following can be set: mediaavailable for display, one or more surveys, conditions for display ofeach survey, and filters for reports. The user interaction can includechanging a media selection. In at least one embodiment, the user canselect media for display and change media selection for display. Thechange of selection can be recorded. The display of the survey can beconditioned upon the percentage of the duration of the media observed bythe user. Another survey can be displayed if the media runs for its fullduration.

In at least one embodiment, the time stamp can record the amount of timethat has passed between the initial display of media on the end-userdevice and the user's interaction with the media. The time stamp canalso record the amount of time elapsed from an earlier-recorded timestamp to the user interaction with the media.

In at least one embodiment, the survey can record the user's answer to aquery regarding the media and it can also record the user's answer to aquery regarding the user interaction. The survey can include one or moreof the following: Pop-up questions and stop questions.

User interactions and timestamps for a plurality of users can berecorded, and each user interaction record can be compared to those ofthe plurality of other users to determine how close each user is to themean score. Users can be ranked based on the comparison. The interactionof a plurality of users can be recorded, and a report of userinteractions can be displayed. A trendsetter algorithm can be applied tothe user interaction record.

In at least one embodiment, the at least some of the above actions canbe performed by a computer-readable media made of instructions for acomputer processor to perform the actions.

In another aspect of the disclosure, a system can include media for oneor more users to sample, a survey that a user may interact with relatingto the media; and Time Stamping. Users can sample media sample using anend-user device to play the media made available electronically via thesystem. The display that a user may interact with can include a Pop-upscreen displayed electronically on the end-user device. A user mayinteract with a survey using the input device of their computer. Timestamping records one or more of the user's actions with relation to themedia or the survey, electronically monitoring and saving reactiontimes, which may then be used to generate a report for electronictransmission to the client sponsoring the survey.

The survey displayed can be determined by the reaction time stamp when auser takes some action.

The system can include a host server, a client computer, and auser/participant computer. The client computer can set up the mediaavailable for display, one or more surveys associated with the media,and conditions for display of each survey. The host computer can displaymedia on the user/participant computer (remotely located from the hostcomputer and the client computer), monitor user interaction with themedia, record (in a user interaction record in a database) a time stampbased on a user interaction (optionally along with the userinteraction), and display (on the user computer) a survey.

BRIEF DESCRIPTION OF THE DRAWINGS

Aspects of this disclosure will become apparent upon reading thefollowing detailed description and upon reference to the accompanyingdrawings, in which like references may indicate similar elements:

FIG. 1 is a diagram of a system according to various embodiments of thepresent disclosure;

FIG. 2 is a diagram of a system according to various embodiments of thepresent disclosure;

FIG. 3 is a diagram of a system according to various embodiments of thepresent disclosure;

FIG. 4 is a flowchart of process data flow in the system according tovarious embodiments of the present disclosure;

FIG. 5 is a flowchart of process data flow in the system according tovarious embodiments of the present disclosure;

FIG. 6 is a flowchart of process data flow in the system according tovarious embodiments of the present disclosure;

FIG. 7 is a flowchart of process data flow in the system according tovarious embodiments of the present disclosure;

FIG. 8 is a Time Stamping report according to various embodiments of thepresent disclosure;

FIG. 9 is a Time Stamping report according to various embodiments of thepresent disclosure;

FIG. 10 is a user display according to various embodiments of thepresent disclosure;

FIG. 11 is a Pop-up display according to various embodiments of thepresent disclosure;

FIG. 12 is a question setup display according to various embodiments ofthe present disclosure;

FIG. 13 is a question setup display according to various embodiments ofthe present disclosure;

FIG. 14 is a question setup display according to various embodiments ofthe present disclosure;

FIG. 15 is a Pop-up question setup display according to variousembodiments of the present disclosure;

FIG. 16 is a Pop-up question report display according to variousembodiments of the present disclosure;

FIG. 17 is an account setup display according to various embodiments ofthe present disclosure;

FIG. 18 is a survey details setup display according to variousembodiments of the present disclosure;

FIG. 19 is a question setup display according to various embodiments ofthe present disclosure;

FIG. 20 is a user participation flowchart according to variousembodiments of the present disclosure;

FIG. 21 is a Time Stamping screen according to various embodiments ofthe present disclosure;

FIG. 22 is a user display according to various embodiments of thepresent disclosure;

FIG. 23 is a video testing environment according to various embodimentsof the present disclosure;

FIG. 24 is an audio testing environment according to various embodimentsof the present disclosure;

FIG. 25 is a question setup display according to various embodiments ofthe present disclosure;

FIG. 26 is a website display according to various embodiments of thepresent disclosure;

FIG. 27 is a user dashboard display according to various embodiments ofthe present disclosure;

FIG. 28 is a Weblinks display according to various embodiments of thepresent disclosure;

FIG. 29 is a Weblinks button display according to various embodiments ofthe present disclosure;

FIG. 30 is a Weblinks button display according to various embodiments ofthe present disclosure;

FIG. 31 is a Weblinks Pop-up display according to various embodiments ofthe present disclosure;

FIG. 32 is a Weblinks testing report according to various embodiments ofthe present disclosure

FIG. 33 is a Weblinks testing report chart according to variousembodiments of the present disclosure;

FIG. 34 is a Weblinks testing report chart according to variousembodiments of the present disclosure;

FIG. 35 is a Weblinks testing report chart according to variousembodiments of the present disclosure;

FIG. 36 is a menu display for adding a new survey question set accordingto various embodiments of the present disclosure;

FIG. 37 is a database for capturing Time Stamping data according tovarious embodiments of the present disclosure;

FIG. 38 is a button for creating a new survey according to variousembodiments of the present disclosure;

FIG. 39 is a survey creation menu according to various embodiments ofthe present disclosure;

FIG. 40 is a survey type setting selection menu according to variousembodiments of the present disclosure;

FIG. 41 is a survey details menu according to various embodiments of thepresent disclosure;

FIG. 42 is a survey details menu according to various embodiments of thepresent disclosure;

FIG. 43 is a media content selection menu according to variousembodiments of the present disclosure;

FIG. 44 is a survey question selection menu according to variousembodiments of the present disclosure;

FIG. 45 is a user criteria menu according to various embodiments of thepresent disclosure;

FIG. 46 is a user invitation menu according to various embodiments ofthe present disclosure;

FIG. 47 is a report type selection menu according to various embodimentsof the present disclosure;

FIG. 48 is a report filter selection menu according to variousembodiments of the present disclosure;

FIG. 49 is a demographics filter selection menu according to variousembodiments of the present disclosure;

FIG. 50 is a behavioral questions based filter selection menu accordingto various embodiments of the present disclosure;

FIG. 51 is a statistical question selection menu according to variousembodiments of the present disclosure;

FIG. 52 is a survey type settings menu according to various embodimentsof the present disclosure;

FIG. 53 is a survey type settings menu according to various embodimentsof the present disclosure;

FIG. 54 is a media content selection menu according to variousembodiments of the present disclosure;

FIG. 55 is a media content and question list menu according to variousembodiments of the present disclosure;

FIG. 56 is an AMT instruction display according to various embodimentsof the present disclosure;

FIG. 57 is an AMT user display according to various embodiments of thepresent disclosure;

FIG. 58 is a survey selection and resumption menu according to variousembodiments of the present disclosure;

FIG. 59 is an individual rater response report filter selection menuaccording to various embodiments of the present disclosure;

FIG. 60 is a minimum average listen selection menu according to variousembodiments of the present disclosure;

FIG. 61 is an individual rater response report according to variousembodiments of the present disclosure;

FIG. 62 is a list of user listening times from an individual raterresponse report according to various embodiments of the presentdisclosure;

FIG. 63 is a traditional report filter selection menu according tovarious embodiments of the present disclosure;

FIG. 64 is a Time Stamping report filter selection menu according tovarious embodiments of the present disclosure;

FIG. 65 is a Weblinks testing report filter selection menu according tovarious embodiments of the present disclosure;

FIG. 66 is a Face-Off report according to various embodiments of thepresent disclosure;

FIG. 67 is a Face-Off emulator according to various embodiments of thepresent disclosure;

FIG. 68 is a Face-Off instruction display according to variousembodiments of the present disclosure;

FIG. 69 is a Face-Off emulator according to various embodiments of thepresent disclosure;

FIG. 70 is a Face-Off emulator according to various embodiments of thepresent disclosure;

FIG. 71 is a display of Face-Off stations and playlists according tovarious embodiments of the present disclosure;

FIG. 72 is a Face-Off emulator according to various embodiments of thepresent disclosure;

FIG. 73 is a Face-Off report according to various embodiments of thepresent disclosure;

FIG. 74 is a Pop-up question display according to various embodiments ofthe present disclosure;

FIG. 75 is a Question Set menu according to various embodiments of thepresent disclosure;

FIG. 76 is a survey station and question set menu according to variousembodiments of the present disclosure;

FIG. 77 is an Audio Face-Off display according to various embodiments ofthe present disclosure;

FIG. 78 is an Audio Face-Off display according to various embodiments ofthe present disclosure;

FIG. 79 is a Video Face-Off display according to various embodiments ofthe present disclosure;

FIG. 80 is a Video Face-Off display according to various embodiments ofthe present disclosure;

FIG. 81 is a Face-Off report according to various embodiments of thepresent disclosure;

FIG. 82 is a Time Stamping report according to various embodiments ofthe present disclosure;

FIG. 83 is a Pop-up question display according to various embodiments ofthe present disclosure;

FIG. 84 is a question set addition menu according to various embodimentsof the present disclosure;

FIG. 85 is a trendsetters group selection menu according to variousembodiments of the present disclosure;

FIG. 86 is a client display according to various embodiments of thepresent disclosure;

FIG. 87 is a trendsetters data table according to various embodiments ofthe present disclosure;

FIG. 88 is a trendsetters data table according to various embodiments ofthe present disclosure;

FIG. 89 is a trendsetters data table according to various embodiments ofthe present disclosure; and

FIGS. 90-119 are flowcharts according to various embodiments of thepresent disclosure

DETAILED DESCRIPTION

The following is a detailed description of embodiments of the disclosuredepicted in the accompanying drawings. The embodiments are described insuch detail as to clearly communicate to one of ordinary skill how tomake and use the claimed invention. However, the amount of detailoffered is not intended to limit the anticipated variations ofembodiments; on the contrary, the intention is to cover allmodifications, equivalents, and alternatives falling within the spiritand scope of the present disclosure as defined by the appended claims.

Various embodiments of this invention can gauge theparticipants/consumer's feelings about the particular feature, contentand related questions being presented in a survey through the use of thevariety of functions and features such as Time Stamping, Pop-upquestion(s), and capturing of data, all of which helps clients take thisinformation and make decisions based on this information, and make theirproducts more appealing. As covered, these processes allow for much morein-depth ways of learning more information than currently exists throughthe various features and functions contained and described herein.“Reaction times” (which a participant doesn't see—it is trackedmechanically via the software), the question(s) that might be asked (atclient's discretion), and the reporting of the findings for a survey,which will help the client improve their products.

This software is a multi-tiered program that allows clients to test notonly music or videos or images, but it also allows them to test theirwebsites through the use of URL's which are part of a survey. Also, theadditional features such as On-Line AMT's via Streaming, (AMT stands forAuditorium Music Test in a traditional research platform) allow theclient to test beyond current measures. And the streaming for the radioFace-Off (or individual station) could use Time Stamping question-askingfunctionality. Additionally, the software tracks How Long it takes aparticipant to respond, and then asks follow-up question(s) on what aclient wants more feedback on. Through the use of the Radio Face-Off,clients can utilize a Real-World environment simulated feel forparticipants showing a car radio with station presets on them, to getbetter information by tracking how long a participant stays on astation, (time-stamp), but also tracks where they switch (tune out), andthe station they go to (tune-in), and can also ask questions when theyswitch to find out Why. With other content, audio, or video beingtested, we time-stamp WHEN a participant first responds to questions. Wetrack the start, stop or first respond, and total duration for thesecontent items. By also providing Pop-up questions within the software asdescribed, it allows clients to dig deeper and know more. To be able totest websites, content such as audio, video, and images, and the manyfeatures and functions described herein, allows clients to make theirsurveys more compelling, and engaging for the participant, which keepsthem more inclined to participate more often, as well as providing morefeedback than before through these features and functions, allows themto get more actionable information to improve their products. Throughthe added use of Time Stamping, and being able to eliminate participantswho don't listen a “minimum average listen” amount of time, the resultscan be made more reliable. Right now, no one really knows how longparticipants listen before responding, or whether participants evenlistened at all.

The system/method provided by software running on a computer and/orservers, utilizes a number of features that provide clients with moredata than can be captured using traditional survey methods. Using acombination of features described herein, the software captures the timein which it takes a participant to respond to various content beingpresented through the use of “Time Stamping”.

In some embodiments, a client sets up surveys using the software whichallows for a variety of ways to measure the results. For Weblinkstesting, a participant (or “user”) is given a URL (website address)within the survey itself and asked to find and review either the websitein its entirety, or a particular area of the URL address given. Once theuser has reviewed the URL accordingly, they click a button (“I FoundIt”), or (“I'm Finished”) or whatever name they want for the button.Once that button is clicked, the system denotes the time taken fromfirst entering the site/URL and when the button is clicked. This“Time-Stamp” is captured. Subsequent question(s) created by the clientare then asked of the participant. For other content such as audio andvideo, Time Stamping captures the response time for other elements ofcontent such as songs, song-hooks, or other audio, as well as videossuch as music, movies, or other media.

In some embodiments, the system enables removal of users from thereports if they don't listen for at least a certain quantity of time.The “Minimum Average Listen” functionality allows clients to weed outparticipants who aren't listening to content for at least a certainquantity of time. We believe that there are participants who may gothrough a survey quickly without really being actively engaged eitherfor the purpose of qualifying for an Award the client is offering forcompleting a survey (trying to win), or they might be a competitorsigning up to try and taint the results by not listening. Until now,clients couldn't really know when participants respond, how much theylisten, or if they even listened at all to content on a survey.

Further, through the use of Time Stamping and reaction times, the systemhas a function called “Set Pop-Up Percentage”, a setting that furtheradds value to a client. A client can set the Pop-up percentage for everyitem on a test, or individual pieces of content. For example, if aclient has a one-minute segment of content (audio, video, stream,podcast, or other type of content being measured), and sets the Pop-uppercentage at 50% (or any percentage they want between 1 and 99), thesystem knows to fire question(s) at any time before 30 seconds havepassed (or 50% in this case). If the user listens/views for more than 30seconds (50%), then there wouldn't be any Pop-up presented to theparticipant based on their “reaction time”. Described herein is also thetechnical process with which that happens. This allows the clients toget more information than could otherwise be gathered which helps themmake better decisions on the content, which helps improve their businessand their product(s).

The Time Stamping and Pop-up percentage is also utilized in the RadioFace-Off feature as well as Face-Offs for Audio, Video, Image, or anytype of content being faced-off. The Radio Face-Off setup allows mediaclients to test music, or other content which are uploaded into thesurvey for users, described herein. Users are asked to listen to theradio as they would in listening in a car or other device which hasradio station presets. The stations are named by the client when settingup the feature. Users are asked to listen normally or based on theinstructions the client provides as part of the survey. The instructionscan vary depending on the client and the content being presented tousers. The goal is to measure how long a user spends on a particularstation and the audio being presented. The user can switch stations atany time (tune-out), and the system will keep track of this in a varietyof ways described herein, such as how long the user listened beforetuning out, what station the user switched to. Also the station beingswitched from (tune in). The system can measure the Time (Time Stamps)on the item being heard, and then track the tune-out, meaning whichstation the user tuned out to if the user switched stations beforecontent had ended. Conversely, the system tracks the “tune-ins” to thestation being switched to. Further, clients can create questions when astation is switched which allow the client to get even more detailedinformation to improve the client's products.

Questions “Pop-up” in a similar fashion to other content describedherein, though it is only based on stations being switched, not theirreaction time, though the system can track the reaction time ascontained and explained herein. This is a client option and can be setto come up only on particular pieces of content, or all content for eachstation that has been uploaded in the survey setup with this feature.

With every feature described, instructions are given to instruct theuser as to what the client is asking them to do. Also, the software canallow clients to “stream” audio into a survey, which is setup anddefined in survey setup with various options described herein, whichallows users to hear the streaming audio when they participate in asurvey that includes the AMT (Stream) feature. This allows clients totest music or audio, and collect data information as described herein.

In some embodiments, the streaming portion could be incorporated into aRadio Face-Off feature which can capture data from the stream and trackwhen users switch stations, which content was playing (being streamed)and ask one or more questions (if desired by the client) about why theyswitched stations. The Face-Off feature could include multiple audiostreams, one for each station being tested. The manner in which thishappens could use the streaming data that would allow a user listeningto a radio station on a more modern radio system which displays thecontent being played (displayed on the user's radio) to be tied into thesystem so that the system or the client can know what content wasplaying, denote when the user switched (Time Stamping, how far into thecontent, or when they switched) and then be able to ask questions (ifdesired by the client) and report that information in results (reports).

Streaming technology, including a “direct link to the system” or the“imbed code to the player” or the like, could allow the collection ofdata from the streaming code of a station. The streaming/Time Stampingand ability to ask questions could also be used within the system morethan just for the Radio Face-Off. This can be a valuable function withthe radio industry. For example, this ability could be used with thePortable People Meter (PPM) with Arbitron, which captures real listeningfor respondents who agree to participate in the rating gatheringmethodology, by being able to utilize a larger database size and bybeing able to ask why participants switched, among many additionaladvantages that can capitalize on the radio ratings service and howratings are derived in a growing number of radio markets.

Additionally, the software tracks “Trendsetters” by using an algorithmthat compares each user's performance against their peers. The softwarechecks the results for each piece of content being tested and comparesthe overall result to each user. When a user does well by being close tothe Mean score (scale question), or other types of questions such asMultiple Choice-Select One or Multiple Choice-select All, the betterthey are as “Trendsetters”. This can help clients identify those userswho are better at predicting content among their peers (those who alsoparticipate in surveys), which makes their input more valuable. Clientscan screen in, and out, these Trendsetters for surveys as well asreports. In addition, some embodiments of the software can show a userwho gives the same score again and again (e.g. 5-5-5-5-5-5-5-5-5-5-5-,etc.), or a sequence of (e.g. 1-2-3-4-5-1-2-3-4-5, etc.), or some othertype of patterned response, as the software can identify individualraters for each piece of content. Generally, such users would end up inthe lower tier of Trendsetters who likely are far off the mean byutilizing some pattern. This is why having the ability to setTrendsetters by up to five levels (which are totally customizable foreach level), such as Top 10%, next 10%, next 30%, next 25%, and next 25%for example, allows a client to search by the top Trendsetters, or evenby the bottom. Aside from enabling a client to know who its weakestraters are, the software can be helpful when looking at results ordeciding which users should be sent a survey or email or some other typeof communication.

Technical Requirements of Preferred Embodiment

The software resides on a server (or client—with the proper software).It's hosted presently at Crystal Tech server, which is a dedicatedserver. A quad core server with mirrored SAS drives and 4 gigs of ram.(More detailed technical specs can be provided). The software is builtwith .Net 3.5. Microsoft SQL Server 2008 is used as the backend. Thesoftware being used to collect data is SQL. The results from the varioustests are stored on the server via SQL data collection tables. Thedevelopment would be 3 tier with the presentation, business logic andthe data layers separate. The system is deployed on a dedicated Windows2008 server with a professional hosting company. A separate version isavailable that can be sold to the station to be deployed by the stationstechnical team. Popup and/or Stop questions are shown viajava-scripting.

Referring first to FIG. 1, some embodiments of the system areillustrated and discussed. The system 100 can include a server 102hosting the software, which is communicatively coupled to a clientcomputer 104, which itself is communicatively coupled to a user computer106. In the illustrated embodiment of FIG. 1, the server 102 hosting thesoftware is where the software resides. The server stores all the data,from the Administrator setting up to the client, questions, survey andreport templates, and many other facets of the software, as well as theclient and user data. In the illustrated embodiment, the Administratorsets up the system-wide functions and features for user by the client,sets up the client, and manages the system. The client can performvarious actions including creating questions, uploading content,creating surveys, sending surveys to the user, viewing results as theuser finishes surveys, making decisions regarding what to play, display,discuss, or making other product adjustments based on the feedback. Insome embodiments, the user signs up, receives a survey invitation, andthen participates in a survey.

Referring now to FIG. 2, some embodiments of the system are illustratedand discussed. The system 200 can include a server 102 hosting thesoftware, which is communicatively coupled to both a client computer 104and a user computer 106. In some embodiments, the client can performvarious actions including creating questions, uploading content,creating surveys, sending surveys to the user, viewing results as theuser finishes surveys, making decisions regarding what to play, display,discuss, or making other product adjustments based on the feedback. Insome embodiments, the user signs up, receives a survey invitation, andthen participates in a survey.

Referring now to FIG. 3, some embodiments of the system 300 areillustrated and discussed. The database server 302 is communicativelycoupled to the hosting server 304 and can send requests and receiveresponses from the hosting server 304. The hosting server 304 cancommunicate with a client 104 over a network 306 which can include theInternet. The hosting server 304 can send requests to the client 104over the network 306 and receive responses from the client 104 over thenetwork.

FIG. 4 illustrates some embodiments of process data flow in the systemrelated to the creation 402 of a survey. The client 104 provides surveydetails, which are communicated to the database server 302, and thedatabase server 302 provides a creation status of the survey, which iscommunicated to the client 104.

FIG. 5 illustrates some embodiments of process data flow in the systemrelated to a user's participation in fulfilling 502 a survey. Thedatabase server 302 provides survey details, which are communicated tothe user 106, and the user 106 provides survey answers, which arecommunicated to the database server 302.

FIG. 6 illustrates some embodiments of process data flow in the systemrelated to the generation of reports 602. The database server 302provides report details, which are communicated to the client 104, andthe client 104 provides report parameters, which are communicated to thedatabase server 302.

FIG. 7 illustrates some embodiments of process data flow in the systemrelated to a client setting up 702 an account. The database server 302provides account setup details, which are communicated to the client104, and the client 104 provides account setup values, which arecommunicated to the database server 302.

Time Stamping

The system or method typically implemented by software running on one ormore general-purpose computers or servers or one or more specificpurpose computers is designed to capture listener opinions about thecontent being presented to them in various forms. To that end, thesystem or method tracks Time-Stamped Reaction Times of the user, Pop-upfeedback, and data collection from users. Clients can take thesefindings and use them to made decisions to improve their products.

Time Stamping can include tracking time elapsed between Start and Stopactions, Pausing actions, Response Actions, or the total duration of anevent or content being tested. Time Stamping can be utilized in websitetesting, also known as “Weblinks”, which involves tracking how long auser takes to find something on a client web site from the URL that theyare given in a survey. Time Stamping can also include testing audio,video, and Face-Offs.

Pop-up feedback can include setting Pop-up percentages or through theuse of Stop Questions.

The process of gathering this information, and presenting the results ina variety of reports and displays for clients is meant to help clientsfine-tune their content, whether it's audio, video, images, streaming orwebsites, through the use of Time Stamping and Pop-ups (which is aJavaScript function) as well as information collected from answeringquestions with these functions, as well as traditional collection ofdata from questions. This is meant to work to analyze the results andimprove client products, whether it's radio, Internet websites,Television, Newspapers or other media that would be able to use oursoftware.

The Time Stamping process is meant to measure the time it takes arespondent (user taking the survey) takes to respond to a particularitem being tested, as well as the total duration. These Time-stampingreaction times would include content such as audio, video, Website URLs,and Face-Offs. Audio content can include music, commercials, radiofeatures, morning shows, podcasts, or any audio content that isuploadable to software. Video content can include music videos,television commercials, television shows, movie trailers, onlinestreaming videos, or any uploadable video to software. Face-Offs caninclude Radio Face-Offs, audio Face-Offs, Video Face-Offs, or ImageFace-Offs. Radio Face-Offs could use song hooks, live streams of radiostation audio content, or other audio content.

Time Stamping information is collected by tracking 1) the start of acontent item, 2) the first reaction a user has to the content item,whether or not the reaction comes within the content itself (such as auser not responding to a 30-second commercial until after the commercialhas ended), and 3) the total duration of time it takes a user to finishscoring and responding to each item being auditioned. The Time Stampinginformation is collected on the server running the software, as pertechnical specifications above. SQL stores the information and theclient then views the results in the various reports available in thesystem.

In an embodiment shown in FIG. 8, a chart 800 of Time Stampinginformation for several media items 802 and a single demographic 804includes Content Length 806, Average Dump/Stop 808, the percentage 810of the content length 806 that the Average Dump/Stop 808 represents, andthe Total duration 812.

Time Stamping can be presented in different ways, depending upon whatthe client chooses. This is accomplished by the client selecting thedemographic they want to view. For example, in the embodimentillustrated in FIG. 9, an additional demographic 902 has been selected.Demographics are selected based on the criteria filter area of thereport configuration page. In the embodiment illustrated in FIG. 9, thedemographics are from the beta-client. Demographics are set in twoways: 1) System administration sets demographics for user across thesystem for all clients, and 2) each individual client sets demographicsat their discretion.

In some embodiments, reaction time between events is collected. Forexample, if there were five (5) questions for a song hook being listenedto, the first response would be the reaction time, and each subsequentresponse's time is reset, and the total time of each is then addedtogether until the “NEXT” button is hit, which is the total duration.

Referring to FIG. 10, an embodiment of the display 1000 that a userwould perceive when Time Stamping is utilized is illustrated anddiscussed. In some embodiments, at least some parts of Time Stampingfunctionality would not be visible to users, as Time Stampinginformation would be collected automatically by the system. In someembodiments, Pop-ups would appear if applicable for the content item,and if set by the client.

In the illustrated embodiment shown in FIG. 10, the display 1000 caninclude content 1002, content length 1004, progress 1006, and questions1008. Time Stamping can be calculated from several points including the“start” of the playing of content, to a user's reaction (either bystopping or pausing, or answering any of the questions 1008, as well asthe total duration of the content.

In the illustrated embodiment of FIG. 11, if the client set the Pop-uppercentage to be, for example, 50% on a two-minute piece of content anda participant didn't listen to at least 50% of it (or one minute), thena Pop-up 1102 would display. The Pop-up can be Java-scripted. The Pop-upcan include one or more questions 1104, and can be any type of questionin the system. The user can respond to a question 1104 by entering ananswer in a field 1106.

As shown in FIG. 12, in some embodiments, a client can create Normal,Pop-up, Stop, Familiarity, Scale, Tired of, or some other type ofquestion by selecting the type from one of the selections choices 1202available. In addition, a client can create additional subtypes ofquestions including multiple choice-select one, multiple choice-selectall that apply, scale, open-ended comment boxes, hot/not, or any othertypes of questions by interacting with a menu 1204.

A client can ask any question, or questions, they want. And the Pop-upfor STOP question (if created for the survey and content being tested)would differ from what the Pop-up question would be. However, the Pop-upthat is shown would be dependent on whether the user hit the stop button(thus stopping the content), or simply started answering questions. Ifthe user stopped the content, then they would get the stop question (butonly if a client set it up to be used); if they hit a question thecontent would continue playing.

The “popup or stop” question data is collected from user responses andstored on the server using the technical requirements. The Pop-up andstop questions can be any type of question the client wants. The“java-scripting” is simply the manner by which the questions arepresented. The difference between Stop and Popups can be described asfollows:

-   -   Pop-up question(s): These are tied with the “Set popup        Percentage” as described in this document. A client sets the        Pop-up percentage and only when those criteria are met do any        Pop-up questions display using java-scripting.    -   Stop Question(s): These are only shown if a participant actually        “Stops” the player on the content they are listening to.        And the Pop-up and/or Stop questions can be any type of question        as shown.

Shown in FIG. 13 is the display 1300 for adding a new survey question,where a client has selected the Pop-up question selection 1301. In theillustrated state of the display, the Popup Configuration over-ride 1302as well as the question type drop-down menu 1304 is present, along witha field 1306 that the client can use to enter answers that a clientwould use for choices. As also shown in the illustrated embodiment ofFIG. 13, a client can select 1308 questions to be mandatory or optional.

As shown in FIG. 14, when the Stop question is selected 1402, multiplequestion types can be selected from a drop-down menu 1404.

As shown in FIG. 15, an embodiment of the system collects all the userresponses, which are made available in various reports in the system. Inthe illustrated embodiment, a client can select report filters 1502 fora Pop-up report. In some embodiments, such as the illustratedembodiment, the filters 1502 can include a specific survey, specificcontent, user demographics such as age groups, user genders, and userethnicities, or other filters.

As shown in FIG. 16, the results 1600 of a selected report can bedisplayed and can include a list 1604 of questions that can be selectedto generate a graph 1602. A Stop Report can be generated in a similarmanner as the illustrated embodiments discussed above.

Time Stamping is set in the system. It is automatic as described below,and cannot be altered by the client. However, the Pop-up percentage canbe set by clients. In order to use the Pop-up function, a client needsto use it, or not use it, at their discretion for a project.

FIG. 17 illustrates an embodiment of a window 1700 used by a client toset up an account. A Pop-up configuration 1702 can be set by default sothat, if a client wants to always set the Pop-up to come up at a defaultpercentage of the content being tested, it will do so.

FIG. 18 illustrates an embodiment where the Pop-up configuration 1802can be included in a Survey Details window 1800 and set when a survey isbeing set up.

FIG. 19 illustrates an embodiment where the Pop-up configuration 1902can be set for an individual content item being tested. This can be donethrough the use of Pop-up questions which can be created on anindividual piece of content.

As shown in the process 2000 illustrated in FIG. 20, once thisinformation is set for a survey, and questions are set, then aparticipant will be sent the survey project 2006 upon responding to theclient's solicitation 2002 for participation by signing up 2004. When asurvey is sent, and participants take the survey project 2006, thenvarious content and features are presented, depending on what the clienthas set up. The information for Time Stamping is stored on the serverutilizing technical specifications as described above.

Showing Time Stamping

As shown in FIG. 21, Time Stamping data can be presented in theillustrated screen 2100. The Timer 2102 tracks the elapsed time for eachevent, which can then be cumulatively added to reach the Total Duration.The Response Time 2104 can show at what elapsed time a user “does”something, which can include Stopping content, pausing content, oranswering the first question. The Player Counter 2106 can show theduration for a particular item of content.

In the embodiment illustrated in FIG. 22, the Time Stamping screen 2100is turned on while a media element 2202 is playing on a display 2200. Insome embodiments, the Time Stamping screen 2100 is not visible.

The system can offer Pop-ups in the form of a question a client can askwhen a participant first responds. A Pop-up question can be presentedwhen a user 1) stops listening, hitting the player stop button, 2)pauses the player, or 3) responds to any question. A Pop-up question canbe presented when a user stops listening prior to the elapse of the “setPop-up percentage” of the content duration.

The embodiment in FIG. 23 illustrates the use of a Time Stamping screen2100 to track Video content 2302 in a testing environment 2300.

The embodiment in FIG. 24 illustrates the use of a Time Stamping screen2100 to track Audio content 2402 in a testing environment 2400.

Website Testing with Time Stamping

Website Links (“Weblinks”) testing is a unique way to get more in-depthinformation from users based on the users being sent to a specific URL.Website “location/placement” of items on a website, and theattractiveness of the area, is believed to be in direct proportion tothe value visitors have to that website. In other words, the client maywant to know if things on the website are easy to find, are placed ingood places on the website. In addition, the client may want to know ifusers like the area being asked about and can articulate what they woulddo to improve it. What might they contribute through the form ofquestions being asked that can help clients make their websites better?

As it relates to radio stations or other medium such as Television, whenlisteners/viewers are directed to a place on that client's website (e.g.“Go to 102.7 KIIS-FM and sign up for a chance at front row tickets toBritney Spears”), many times the client hasn't put them in a goodposition on the website, and/or is unattractive to the viewer. Thisimpacts what they think of their product, whether subliminally, orotherwise.

The Weblinks testing can be done in one of two ways: Time Stamping aquestion and simply putting a URL into the project and asking questionsabout a website being tested. When Time Stamping during Weblink testing,the total duration is not calculated for that feature as Weblinkstesting is intended to determine “When” a user finds something, althoughsuch a capability is possible and should be understood to be within thescope of the present disclosure.

As shown in FIG. 25, a client interacting with the “Add New Question”display 2500 can select “Time Stamping Question” 2504 when selecting anew type of question to add from a drop-down menu 2502. This is actuallya question that is inserted into the feature to indicate that Weblinksis using a Time Stamping question. Most times the Time Stamping questionwould be used. A client may also determine to just put a URL into theproject and ask questions about the web site being tested.

The embodiment in FIG. 26 illustrates a site 2600 with the actual TimeStamping timer 2602 being shown. A user wouldn't see the Time Stampingfeature. Clients can create a survey with an actual URL, website link,such as “www.google.com”, or clients can create a survey with a moredefinitive URL, such as“http://www.amazon.com/gp/product/B00138KOTA/ref=sr_1_album_2_rd?ie=UTF8&child=B00138IVGI&qid=1255199639&sr=1-2”.Clients can create questions for this link and make it part of thesurvey.

FIG. 27 illustrates an embodiment of a user Dashboard 2700 through whichusers can be directed to a URL automatically in a survey. Once a userchooses a survey 2702, the user can click “Start” 2704 to begin thesurvey.

In the embodiment illustrated in FIG. 28, a user selects the “Website TSSurvey” from the list of surveys displayed in the Dashboard in FIG. 27,which leads to the website link 2800 illustrated in FIG. 28.Instructions 2802 are on top of the website link 2800 in the survey. Inthe illustrated embodiment, a Time Stamping Timer 2804 is visible; insome embodiments, Time Stamping Timer 2804 is not visible. Theseinstructions 2802 can be totally customizable by the client. Theinstructions are meant to ask users to go to a particular area of theURL being provided and then, once found, they would click a button. FIG.29 illustrates an embodiment of such a button 2902.

As shown in FIG. 29, one a user finds the URL, the user can click thebutton 2902. The button can state “Click Here”; in some otherembodiments, the button can state “I Found It”, as illustrated in FIG.30 as button 3002. Once the instructions are closed, the Time Stampingis engaged, as shown by Time Stamping Timer 2904 in FIG. 29. The TimeStamping Timer tracks how much time elapses until the button is clicked.For example, in FIG. 28, at least 6 seconds on have elapsed on TimeStamping Timer 2804 before the instructions are closed. Also, in FIG.29, at least 14 seconds have elapsed on Time Stamping Timer 2904 untilthe user finds the URL and clicks the button.

As shown in FIG. 31, once the user clicks the button, such as the button2902 illustrated in FIG. 29, then the client-created questions 3102,which can be any number or type a client wishes to ask, are displayed3104 to the user.

The resulting report 3200 illustrated in FIG. 32 is shown in the systemsoftware. The report 3200 can include a list 3202 of questions that werepresented to users, and a chart 3204 illustrating user responses to agiven question. The chart report 3300 illustrated in FIG. 33 presents tothe client an indication 3302 of how much time elapsed for various userswhile they searched for the URL.

The chart reports 3400 and 3500 illustrated in FIGS. 34 and 35,respectively, show indications 3402 and 3502 of how various usersresponded to a question presented after they found the URL. These arejust example questions and responses. It's up to the client what theywant to ask. The most important aspect of this is the TimeStamping—i.e., the answer to the question “How long did it take for aparticipant to find the item the client asked them to find?”

Weblinks Setup

Referring now to FIG. 36, the setup process for the Weblinks feature isillustrated and discussed. As shown in FIG. 36, clients select thefeature type 3602 from a drop-down menu 3603. In the illustratedembodiment, the client has selected “Website Links Testing” from thedrop-down menu 3603. The client types in the URL 3604 to which the userswill go, enters the website description 3606, and, if necessary, uploads3608 the website image of the page that the client wants shown when thepage is first displayed. Then, the client can save and add questions3610 as the client sees fit. A client can add as many website URL linksas the client wishes for a particular survey.

The combination of Time Stamping and reaction times to the variouselements, and how important it is to analyze and adjust that content,whether it's audio, video, image, or websites through the variousfunctions and features presented herein, is critical to improving aclient's ratings (such as Arbitron or Nielson), viewership, readership,or any business looking to utilize this tool. For example, a cardealership with a database, or through solicitation that invitesparticipation, could ask questions about their business, cars they areintending to buy, how well their salespeople are doing, and so forth,including gathering information about their content (such as audio adson the radio, television ads, billboard ads, or other forms ofadvertising). Its use is not limited to any one type of business as ithas applications across multiple platforms.

Calculation of Time Stamping in Code

As shown in FIG. 37, Time Stamping can be captured in various ways in anSQL database. For example, in the illustrated embodiment, Time Stampingdata is captured in an SQL database 3700. The illustrated embodimentshows the results of a survey having an ID of “428” 3702 involvingcertain media, which are identified by “inSurveyMediaID” 3704. In theillustrated embodiment, the Time Stamping data is captured from aFace-Off; as a result, multiple columns 3706 display values of “Null”.The response time of each media is saved into the column labeled“inTimePlayed” 3708. In the illustrated embodiment, a media item 3710having an ID of “6532” is an image; as a result, the corresponding value3712 in the “inTimePlayed” column 3709 for that media item 3710 is zero.

Survey Setup

Referring now to FIGS. 38-42, steps in a process for creating a surveyare illustrated and discussed. As shown in FIG. 38, a client can createa new survey by clicking on button 3800 in the software. As shown inFIG. 39, the client can be presented with a display 3900 that includesthe options to create a new survey 3902, copy a survey template 3904, orcopy an existing survey 3906. As shown in FIG. 40, should the clientchoose to create a new survey, the client then selects the type settingsof the new survey from a display 4000, which can include TraditionalLayout 4002, AMT Layout 4004, or some other Feature Type 4006, such asWeblinks, Website Drag & Drop, Radio Face-Off, or some other Face-Off.As shown in FIG. 41, the client can utilize a main survey setup page4100 to name the survey 4102, set the start date and end date 4104, andset the Pop-up configuration 4106 related to Pop-up questions anddetermine other various settings. As shown in FIG. 42, additionalparameters 4202 can be set up on the main survey setup page 4200. All ofthis information can be stored and saved on the software residing on theserver containing the database.

Referring now to FIGS. 43-44, additional steps in a process for creatinga survey are illustrated and discussed. As shown in FIG. 43, dependingon the survey type, a client can select the Media 4302. Media isclassified as 1) Audio, 2) Video, and 3) Images, such as .jpegs, .tiffs,etc. The selections are stored and saved in the survey as well as in theserver database. As shown in the illustrated embodiment, selected media4304 that are highlighted are added by the system administrator; othermedia are added by the client. As shown in FIG. 44, questions are thencreated in the next step. Questions can be added to each piece ofcontent 4401 or applied for all images. The audio, video, or image beingpresented 4401 to the user has the questions attached 4402 per clientsetup. The client can click various icons to edit 4406, preview 4404, ordelete 4408 a question. All the information created is stored to thedatabase in the server for each survey being created.

Referring now to FIGS. 45-46, additional steps in a process for creatinga survey are illustrated and discussed. As shown in FIG. 45, users areselected using the criteria 4502 shown. Selections are saved and storedfor the next step. As shown in FIG. 46, an invitation is displayed 4602,users are selected, personalization fields are selected 4604, and thesurvey can be sent (immediately or at a later time) 4606. Prior tosending the survey, the user can preview the survey.

Referring now to FIGS. 47-48, steps in a process for accessing orgenerating a survey report are illustrated and discussed. As shown inFIG. 47, survey reports are available in a variety of types based on thesurveys sent and the input given by each user collected and presented inthe viewed report. The client can select 4704 a report from a drop-downmenu 4702. As shown in FIG. 48, the client can select filters for thereport, which can include previous filters or new filters, and can besearched based on available options 4802, which can include demographicsfilters, behavioral question filters, montages, statistical questions,location information, or other filters.

Referring now to FIGS. 49-51, various types of filters accessible to aclient in a process for accessing or generating a survey report areillustrated and discussed. As shown in FIG. 49, demographics filters4902 available to the client can include Age groups, genders, andethnicities of the users. As shown in FIG. 50, behavioral questionsbased filters 5002 may be available to the client. In addition, as shownin FIG. 51, statistical questions 5102 may be selected by the client asfilters in a report. The filter information can be stored on a databasein the server.

AMT Stream Survey Setup

The system also has a feature that allows a client to conduct a musictest “Live” on the air (their radio broadcast, such as 102.7 FM), and/orto stream it live on their websites. When a client signs up for theservice, the central server gets their streaming information. This datais collected as shown in FIGS. 52-55. This makes it easy for a client toset up an AMT, as the streaming information is already there. All theyhave to do is set up the survey. They can choose up to 600 songs to betested on each AMT survey. The selection of the songs is easy to do, asFIGS. 52-54 show.

As shown in FIG. 52, the client can access a type settings display 5202from which the client can pick the station name 5204 and set the defaultquestion set 5206. As shown in FIG. 53, the client can also set thestreaming media type 5302 and URL 5304. As shown in FIG. 54, a clientcan select songs by adding media from a library 5402 by searching 5404for content to add from the library. In addition, the client can selectsongs by uploading new media 5406.

As shown in FIG. 55, clients can change the order of songs 5502 as well.The client can also select and modify the order of questions 5504 forthe AMT. The client can re-shuffle the order, or move songs up or downin the order they want it to appear on the test. Then, users areselected, and surveys are sent through the same process as other surveysdescribed herein.

As shown in FIG. 56, the stream can be provided in the survey so userssimply start the survey and the (completely customizable) instructions5602 are presented in a display 5600 for the AMT for users. As shown inFIG. 57, once the instructions close, the streaming data 5702 is fed tothe user through the software. As the user listens to the stream 5702,the user then follows along with hooks and answers questions 5704presented. Collection of the data is done as with all questions in thesoftware as described herein.

FIG. 58 illustrates a display 5800 after a user has started, but notcompleted, one or more surveys 5802. The user can start 5803 a newsurvey 5804, and the user can resume 5806 the pending surveys 5802.

Average Minimum Listening

In some embodiments, a number of reports, including Individual RaterReports, traditional Reports, Weblinks Reports, and Time StampingRepots, can feature Average Minimum Listening.

As shown in FIG. 59, to utilize Average Minimum listening when selecting5902 Report Filters for Individual Rater Responses, a client 1) picksthe “Report Type” 5902, 2) selects the Survey under a “Filters” field5904, 3) selects the content a user is to view first 5906, and 4)determines the minimum average listening value 5908 from a drop-downmenu 5910.

In the embodiment illustrated in FIG. 60, the client selects the MinimumAverage Listening time from a list 6002 of available quantities of timein the drop-down menu 5910. Selecting a given quantity as the MinimumAverage Listen specifies that a user must have listened to at least thegiven quantity of seconds in order to be included in the selected reportto be generated. In some embodiments, if a user doesn't listen to atleast the Minimum Average Listen quantity of time, the user will not beincluded in the results in the generated report.

As shown in FIG. 61, an Individual Rater Response Report 6100 shows thatsome users have either not listened at all or have only listened for asecond or two. For example, at least two users 6102 have not listened atall, as shown in their corresponding “Avg. Time” cells 6104. In fact, asshown in FIG. 62, the report in FIG. 61, when users are sorted byascending listening time 6200, illustrates that multiple users 6202 didnot listen at all.

If the clients in FIG. 61 had set a minimum listening time of 5 seconds,such results would not be present in the report and would not affect theoverall results. Because users that listen to a few seconds of contentmay not have any value in a report to a client, clients may use someembodiments of the Average Minimum Listening functionality to weed outsuch users from generated reports.

As shown in FIGS. 63-65, a client can, utilize Average Minimum listeningin a Traditional Report, a Time Stamping Report, and a Website LinksTesting Report, respectively. As shown in the embodiment illustrated inFIG. 63, a client who wishes to utilize Average Minimum listening in aTraditional Report selects the Survey 6302 and the Average MinimumListen quantity 6304. As shown in the embodiment illustrated in FIG. 64,a client who wishes to utilize Average Minimum listening in a TimeStamping Report selects the Survey 6401, the Age Groups of users 6402that the client wishes to include in the report, and the Average MinimumListen quantity 6404. As shown in the embodiment illustrated in FIG. 65,a client who wishes to utilize Average Minimum listening in a WebsiteLinks Testing Report selects the Survey 6502, the website that theclient wishes to include in the report 6504, and the Average MinimumListen quantity 6506.

Face-Offs

Radio Face-Off

The Radio Face-Off feature tracks the following:

-   -   a) how long a user spends listening to each song on the        respective station the user is listening to    -   b) when a user switches stations, and the subsequent Time        Stamping spent listening.        The process continues until the survey ends.

In addition to Time Stamping, the Face-Off feature tracks the following:

-   -   a. “tune outs” (where a user is switching—what station)    -   b. “tune ins” (where a user tuned in from—which station)    -   c. Most tuned out song for each station (Most switched)    -   d. Station Most switched to    -   e. Average length of listening        This feature could be used with live streaming of radio stations        to collect Time Stamping data for respective content and ask        questions. In some other embodiments, the feature can be used        with uploaded content.

FIG. 66 illustrates an embodiment of a Face-Off report where at leastsome of the above tracked items are displayed in a report for theclient.

FIG. 67 illustrates an embodiment of the PP Emulator 6700 used for theRadio Face-Off feature. The PP Emulator utilizes Reactions times, whichcan be displayed in a Time Stamping Timer 6702. In the illustratedembodiment, the Time Stamping Timer 6702 indicates that 28 seconds haveelapsed in a Time Stamping event. In some embodiments, the Time StampingTimer 6702 is invisible.

As shown in FIG. 68, users are asked to start listening as though theywere driving in a car. The system starts tracking the time when a usersees the instructions. The Time Stamping Timer 6702 in FIG. 68 ispartially hidden by the instructions.

Once these instructions are closed, then the user takes an action tostart the Face-Off feature. The action taken may depend on theinstructions provided. For example, the user may be prompted to start onany station to which the user would normally first listen or the usermay be prompted to start on a specific station.

As shown in FIG. 69, once a user begins listening to a station, the TimeStamping Timer 6702 resets to the beginning (zero). In the illustratedembodiment, the user has begun listening to a station 6902, and the TimeStamping Timer 6702 has reset and currently indicates that one secondhas elapsed from the reset.

The software continues to record time for the content on the stationuntil either the song ends or the station is changed (switched) by theuser. The process continues until the Face-Off feature is completed(i.e., all songs finish). Each song starts at the beginning.

As shown in FIG. 70, the user has switched the station from “KIIS-FM”6902 to “AMP-FM” 7002, which has reset the Time Stamping Timer 6702.

As shown in FIG. 71, which illustrates playlists of stations 7102 andcorresponding songs played by those stations in an embodiment of theFace-Off, once the user starts on any available station 7102, all of theloaded songs start playing, although only the station selected by theuser is heard audibly. For example, in the illustrated embodiment, theuser listened to all of the song “Fallin'” 7104 first on Station 1, asdenoted by the entry of “ALL” 7106 in the corresponding cell for thesong in the column titled “Time Listened” 7105. At the same time, thefirst songs on Stations 2, 3, and 4 are started but are not heardaudibly by the user. The Face-Off process continues until all songs havefinished playing.

In this manner, the Radio Face-Off can help determine what causes usersto tune out and user the information collected to make better products.Although all the songs in the illustrated embodiment were generally ofthe same length, which can enable a client to assessstation-against-station performance, the Face-Off feature is not dilutedif songs of varying lengths are uploaded per the setup described above.

As shown in FIG. 72, the system will display a message in 7202 oradjacent to 7204 the emulator 6700 when the Face-Off process hascompleted.

As shown in FIG. 73, a Face-Off report 7300 shows the Face-Off featurebeing utilized to track multiple stations 7302, with the multipleutilizations being merged into the illustrated report 7300 that displaysstations 7302 to which users have switched while the Face-Off feature isbeing utilized.

As shown in FIG. 74, a client can, at its discretion, also ask Pop-upquestions 7401 in a Pop-up display 7402 when a user switches the radiostation. This allows even more information to be gathered. In additionto all the information described above, clients can dig deeper, whichhelps them fine-tune their content. If a user never switches stations,they might not be presented with questions.

As illustrated by an embodiment in FIG. 75, the Radio Face-Off featurecan be set up by a client in a menu display 7502. The client can selectthe Face-Off feature from a drop-down Type menu 7504 and can select“stations” as the type 7506 of Face-Off. The client decides, in someembodiments, how many stations 7508 the client wishes to create. Theclient can name 7510 the stations that they wish to create and select7512 the content for the station to utilize. Content can include songhooks, full versions of a song, commercial breaks, jock content (i.e.,announcers), jingles, or other content that would represent an actualperiod of radio broadcasting. Song hooks can include portions of a songthat can be any length. Songs can be selected from a drop-down menu, alibrary, or they can be uploaded. The client can save the question setand additionally add new questions 7514. In addition, the client canname 7516 the Face-Off Title. After selecting the media content for astation, the client can create questions to be asked when a userswitches stations.

As illustrated in FIG. 76, a client can access a Survey Questions area7602 of the system after setting up the Face-Off feature. The client canview a list 7604 of stations created as well as a list 7606 of surveyquestions. The client can expand each station displayed in the list 7604to ensure that the list 7604 is correct.

Audio Face-Off

Audio Face-Off can utilize the same Time Stamping feature as RadioFace-Off, whether it's audio or video, no matter which type of media aclient is testing. The feature captures the start time, the stop time,the pause time, and the total duration of time spent to answer all thequestions before a user continues onto the next item on a survey.

Questions can be asked of the user in between listening to each item aswell. The use of Popup or Stop questions can be implemented at clientdiscretion.

FIG. 77 illustrates an embodiment of the Audio Face-Off feature whereaudio content 7702, such as songs, are presented to the user in adisplay 7700. In the illustrated embodiment, the Face-Off feature tracksa user's listening to either songs by the Beatles or songs by theRolling Stones. As shown in FIG. 78, Time Stamping functionality isutilized, as illustrated by the Time Stamping Timer 7802, to track theuser's listening to the presented audio content 7702 in display 7700.

Video Face-Off

Referring now to FIG. 79, an embodiment of the Video Face-Off isillustrated and discussed. Similar to the Audio Face-Off, the user ispresented with a display 7900 that includes one or more videos 7902, andthe user's viewing of the presenting videos is tracked. As shown in FIG.80, Time Stamping functionality is utilized with a Time Stamping Timer8002 to track the user's listening to the video content 7902 presentedin display 7900.

As shown in FIG. 81, Face-Off reports 8100 for Videos can be accessed bythe client and can display so or all of the same types of informationavailable in reports for Radio Face-Offs discussed above. In addition,as shown in FIG. 82, Time Stamping reports 8200 can be generated for theVideo Face-Off and viewed by the client.

Ultimately, the Face-Off functionality is designed to dig deeper intowhy users feel as they do about content. So not only do clients learnthe scores (results, e.g. “Mean score, Familiarity, etc.), but clientscan also know when users respond, and why users respond.

In the embodiment illustrated in FIG. 83, a Pop-up question 8304presented in a Pop-up display 8302 queries a user who has stoppedlistening to a media item presented in a Face-Off feature. In thismanner, the user can provide feedback indicating why the use stoppedlistening or viewing the content.

The process for loading Image, Video or Audio Face-Offs, as shown inFIG. 84, is the same as the Radio Face-Off loading process describedabove, although Image Face-Off does not utilize Time Stamping. As shownin the illustrated embodiment of an Add Question Set menu 8400, insteadof selecting “Stations” as the Face-Off Type 8402, a client can select“Media Items”. The client can select between Audio, Video, or Image asthe Media Type 8404. In the illustrated embodiment, the client hasselected the Audio Media Type 8404.

Trendsetters

Trendsetters refers to how a user performs against his or her peers,which refers to the user's proficiency in scoring content presented tothe user.

Trendsetters is an algorithm in a system which takes data collected fromeach individual user and applies calculations to determine the user'sscoring proficiency against that of other users. The informationprovided by Trendsetters can be customized by the client and can also beavailable in the filtering criteria.

Referring to FIG. 85, a client can customize trendsetters to presentusers who are calculated to have a certain range 8502 of scoringproficiency. For example, a client can select Trendsetters to displayusers whose calculated proficiency is in the top 20th percentile 8504.

In another embodiment, illustrated in FIG. 86, the user can utilize amenu display 8600 to customize the Trendsetters settings to provide oneor more sets 8602 of users based on scoring proficiency. For example,the client can set group A 8604 to be users with a scoring proficiencyin the top 20th percentile, while group B 8606 can be set as users witha scoring proficiency in the next 20th percentile, and so forth forgroup C 8608, group D 8610, and group E 8612.

A user's scoring proficiency is determined as how close the user'sindividual scores of content are to the mean of all listener's scores.The closer a user's scores are to the mean score, the more proficient ascorer the user is.

Referring next to FIG. 87, calculations of individual and overallperformance to identify Trendsetters are illustrated and discussed.Trendsetter ratings are calculated based on both individual and overallperformance. For example, in the illustrated table 8700, the scores forall users 8704 are listed, with the individual scores of each user foreach media item displayed in columns 8706. The mean score of all usersfor each media item is displayed in column 8708.

As illustrated in FIG. 88, once the individual scores 8802 are known foreach user, the deviation of each user for a given media item can becalculated in Table 8800. In some embodiments, the formula for thedeviation of each user for a given media item is as follows:

Individual Deviation=Absolute (User Score 8802−Mean Score 8804)

Next, the total deviations for each user is calculated as:

Total Deviation 8803=Sum (All Individual Deviations for a User)

For example, in the illustrated embodiment in FIG. 88, user Steve has aTotal Deviation 8803 of 2.31, as shown in cell 8805. Under theTrendsetters algorithm, the users with the greatest scoring proficiencywill have the smallest total deviation and can be ranked from greatestto least scoring proficiency. For example, Steve has the highest scoringproficiency 8806 because he has the lowest Total Deviation 8803, asillustrated in cell 8805.

As shown in FIG. 89, each user's 8901 scoring proficiency rating 8806 inFIG. 88 is determined by submitting each user's Total Deviation 8902 toa series of manipulations in table 8900. First, each user's TotalDeviation 8902 is multiplied by “−1” 8903 to give the user's Raw Score8904. Next, the largest Total Deviation 8902 is added to each of the RawScores 8904 to give each user's Trendsetter Score 8905. For example, inthe illustrated embodiment, Josh has the largest Total Deviation of15.31, as shown in cell 8908, which is added to each user's Raw Score8904 to give each user's Trendsetter Score 8905. Each user's Trendsetterscore 8905 is then multiplied by 100 to give each user's scoringproficiency rating 8906. For example, in the illustrated embodiment,Steve's Total Deviation 8910 of 2.31 is multiplied by −1 and Josh'slargest Total Deviation 8908 of 15.31 to get a Trendsetter Score 8912 of13, which is multiplied by 100 to give Steve a scoring proficiencyrating 8914 of 1300.

In this way, the user with the highest scoring proficiency receives thehighest rating. For example, in the illustrated embodiment, Steve hasthe lowest Total Deviation 8910 at 2.31, indicating that he had thegreatest scoring proficiency, as illustrated 8806 in FIG. 88.

Survey Processes

Referring now to FIG. 90, a process 9000 by which a user can be allowedto participate in a Traditional Survey is illustrated and discussed. Asshown in block 9002, a user can be presented with a welcome message, ifany. As shown in block 9004, the user can be presented withinstructions, if there are any. As shown in block 9006, the user can bepresented with Preamble Audio/Video, if there is any.

As shown in block 9008, the user can be presented with TraditionalSurvey Question Sets. As shown in Blocks 9010 and 9012, if the mediatype involved in the survey is not Audio or Video, then questions willbe displayed in a question set, and the process will proceed to point Y.As shown in blocks 9010 and 9014, if the media type involved in thesurvey is Audio or Video, the Audio or Video will be displayed to theuser, along with questions in a question set, and the process willproceed to point Z.

Referring now to FIG. 91, a process 9100, continued from FIG. 90, bywhich a user can be allowed to participate in a Traditional Survey isillustrated and discussed. As shown in block 9102, a process proceedingfrom point Z will determine if media is paused or stopped. As shown inblocks 9116 and 9118, if the media is not paused or stopped, or if theprocess is proceeding from point Y, the user will be allowed to respondto survey questions, the responses to which are saved, along with atimestamp, and the process ends. As shown in block 9104, if media ispaused or stopped, a Media Timestamp is saved. As shown in block 9106, adetermination is made as to whether the Media Timestamp is less than aPop-up configuration percentage. As shown in block 9110, if the mediaTimestamp is less than a Pop-up configuration percentage, the user ispresented with Pop-up and Stop questions, if there are any. As shown inblock 9108, if the Media Timestamp is not less than a Pop-upconfiguration percentage, the user is presented with Stop questions, ifthere are any. As shown in block 9112, the user responds to questionspresented. As shown in block 9114, user responses are saved.

Referring now to FIG. 92, a process 9200 by which a user can participatein a Face-Off Survey is illustrated and discussed. As shown in block9202, a user is presented with a welcome message, if there is any. Asshown in block 9204, the user is presented with instructions, if thereare any. As shown in block 9206, the user is presented with PreambleAudio/Video, if there is any. As shown in block 9208, the user ispresented with a Face-Off Question Set. As shown in block 9210, the useris presented with stations, to which the user listens. As shown in block9212, a determination is made, after a user has begun listening tostations, after the process has proceeded from point DD, or after allstations have been determined in block 9218 to have not finishedplaying, as to whether a station has been switched. As shown in block9214, 9218, and 9222, if a station is determined to have not beenswitched, then the station finishes playing, at which a determination ismade in block 9218 as to whether all stations have finished playing. Ifthey have, then the user must, in block 9222, block on a Next button toend the Face-Off Survey and allow the process to proceed to point CC. Asshown in block 9216, if a station has been switched, then a SongTimestamp is saved. As shown in block 9220, a determination is made asto whether a station has been switched to a new station. If it has not,the process proceeds to point BB; if it has, then the process proceedsto point AA.

Referring now to FIG. 93, a process 9300, proceeding from point AA inFIG. 92 by which a user can participate in a Face-Off Survey isillustrated and discussed. As shown in block 9302, a determination ismade whether there is any question for a song of a station. If there isno question to the song on the station, as shown in block 9304, the nextstation song is played, and the process proceeds to point DD. As shownin block 9306, if there is a question for the song on the station, theuser is presented with Pop-up questions, if there are any. As shown inblock 9308, the user responds to the questions. As shown in block 9310,the responses are saved, and the process proceeds to block 9304.

Referring now to FIG. 94, a process 9400, proceeding from point BB inFIG. 92 by which a user can participate in a Face-Off Survey isillustrated and discussed. As shown in block 9402, a determination ismade whether a Next button is clicked. If not, as shown in blocks 9404and 9406, the process stops and continues later if the Next button isclicked, the Survey Status is saved, and the process proceeds to pointEE. It the Next button is block, as shown in block 9408, a determinationis made whether there are any questions for the song on the station. Asshown in blocks 9410, 9412, and 9414, if there is a question for thesong on the station, the user can be allowed to view Pop-up questions,if there are any, respond to the questions with responses that aresaved. As shown in block 9416, the user can be allowed to view follow-upquestions. As shown in block 9418, the user can be allowed to respond toquestions. As shown in block 9420, the responses are saved.

Referring now to FIG. 95, a process 9500, proceeding to point AAA bywhich a user can participate in a Face-Off Survey is illustrated anddiscussed. As shown in block 9502, a user is presented with a welcomemessage, if there is any. As shown in block 9504, the user is presentedwith instructions, if there are any. As shown in block 9506, the user ispresented with Preamble Audio/Video, if there is any. As shown in block9508, the user is presented with a Face-Off Question Set. As shown inblock 9510, the user can be allowed to listen to an Audio/Video item. Asshown in block 9512, a determination is made whether the Audio/Video isswitched. If not, as shown in block 9514, the Audio/Video continues tofinish playing. If the Audio/Video is switched, as shown in block 9516,an Audio/Video Timestamp is saved, and the process proceeds to pointAAA.

Referring now to FIG. 96, a process 9600, proceeding from point AAA bywhich a user can participate in a Face-Off Survey is illustrated anddiscussed. As shown in block 9602, a determination is made whether anAudio/Video item is switched to a new Audio/Video item. If anAudio/Video item is switched to a new Audio/Video item, as shown inblocks 9604 and 9606, the user can be allowed to view Pop-up questionsand respond to the Pop-up questions. As shown in block 9608, theresponses are saved, and the process proceeds to point BBB. As shown inblock 9610, if an Audio/Video item is not switched to a new Audio/Videoitem, then the user can be allowed to click Next to end the Face-Offsurvey. As shown in blocks 9612 and 9614, the user can be allowed toview Pop-up questions and respond to the Pop-up questions. As shown inblock 9616, the responses are saved. As shown in blocks 9618 and 9620,the user can be allowed to view follow-up questions and respond to thefollow-up questions. As shown in block 9622, the responses are saved.

Referring now to FIG. 97, a process 9700 by which a user can participatein a Weblinks Survey is illustrated and discussed. As shown in block9702, a user is presented with a welcome message, if there is any. Asshown in block 9704, the user is presented with instructions, if thereare any. As shown in block 9706, the user is presented with PreambleAudio/Video, if there is any. As shown in block 9708, the user ispresented with instructions. As shown in block 9710, the user can beallowed to view a website. As shown in block 9712, the user clicks an “IFound It” button. As shown in block 9714, the Weblinks Timestamp issaved. As shown in blocks 9716 and 9718, the user can be allowed to viewPop-up questions and respond to the Pop-up questions. As shown in block9720, the responses are saved. As shown in blocks 9722 and 9724, theuser can be allowed to view follow-up questions and respond to thefollow-up questions. As shown in block 9726, the responses are saved.

Referring now to FIG. 98, a process 9800 by which a user can participatein a survey is illustrated and discussed. As shown in block 9804, a usercan be allowed to view a login page. As shown in block 9806, the usercan be allowed to enter login details, which can include email ID,password, or a security code. As shown in block 9808, the user'scredentials are checked. Checking credentials can include sending theuser's credentials to a database 9802, which then returns adetermination of the user's validity. As shown in block 9810, adetermination is made whether the user is valid. If not, the user isreturned to the login page. If yes, as shown in block 9812, the user canbe allowed to view a dashboard. A request for user and survey detailscan be sent to the database 9802, and the details can be received fromthe database 9802. As shown in block 9814, a determination is madewhether the user has clicked on a survey start or resume link. If theuser has, as shown in block 9816, the survey status can be acquired byrequesting the database 9802 to provide survey details. As shown inblock 9818, the user can be allowed to view a welcome page that has beenrequested and received from database 9802. As shown in block 9820, theuser can be allowed to view an instruction page that has been requestedand received from database 9802. As shown in block 9822, the user can beallowed to view Preamble Audio/Video that has been requested andreceived from database 9802. As shown in block 9824, survey questionsets are retrieved from database 9802, and the process proceeds to pointE.

Referring now to FIG. 99, a process 9900 proceeding from point E bywhich a survey type is selected is illustrated and discussed. As shownin block 9902, a determination is made as to the question set type.Depending upon the survey type, the process will proceed to a differentpoint. For example, if the survey type is Traditional, the process willproceed to point A. If the survey type is Face-Off Station, the processwill proceed to point B. If the survey type is Face-Off Media, theprocess will proceed to point C. If the survey type is Weblinks, theprocess will proceed to point D.

Referring now to FIG. 100, a process 10000 proceeding from point Aenabling a user to participate in a traditional survey is illustratedand discussed. As shown in block 10002, question set details arerequested and received from database 9802 to check for the traditionalsurvey question type. As shown in block 10004, a determination is madewhether the question set type is Audio/Video. If not, as shown in block10032, the user can be allowed to view an image file and normalquestions. If yes, as shown in block 10006, the user can be allowed toview the Audio/Video file and normal questions. As shown in block 10008,a determination is made whether an Audio/Video file is being played. Ifnot, the process proceeds to allow the user to answer normal questionsin block 10034. As shown in block 10010, the timer for Audio/Video TimeStamping is started in the background. As shown in block 10012, adetermination is made whether the Audio/Video file is paused or stopped.If not, as shown in block 10014, the Audio/Video file can be allowed tofinish playing. As shown in block 10016, the Audio/Video Time Stampingtimer is stopped, and the Time Stamping details are stored in database9802. In block 10018, a determination is made whether there is a Pop-upor Stop question. If there is, as shown in block 10020, then adetermination is made whether the Media Time Stamp is less than thePop-up configuration percentage. If not, as shown in blocks 10022 and10024, the user can be allowed to view and answer Stop questions, theresponses of which are saved in database 9802. As shown in blocks 10026and 10028, the user can be allowed to view and answer Pop-up and Stopquestions, the responses of which are saved in database 9802. As shownin blocks 10030, 10034, and 10036, the user can be allowed to view andanswer normal questions, the responses to which, along with totaldurations and survey status, are saved in database 9802. The processthen proceeds to point E.

Referring now to FIG. 101, a process 10100 proceeding from point B bywhich a user can participate in a Face-Off Station survey is illustratedand discussed. As shown in block 10102, the user can be allowed to viewa Face-Off Station question set, the details of which are requested andreceived from database 9802. As shown in block 10104, a determination ismade whether the user has clicked on a station to play. If not, as shownin block 10106, the user is prompted to play at least one station. Ifyes, as shown in block 10108, the selected station if played, and astation Time Stamping timer is started in the background. As shown inblock 10110, the user can be allowed to listen to the station. As shownin block 10112, a determination is made whether the station is switched.If not, as shown in block 10114, the station finishes playing. As shownin block 10116, a determination is made whether all stations havefinished playing. As shown in block 10118, a determination is madewhether the Next button is clicked. As shown in block 10120, adetermination is made whether there are follow-up questions. If so, asshown in blocks 10122, 10124, and 10126, the user can be allowed to viewand answer the follow-up questions, the responses to which are saved,along with the survey status, and saved in database 9802. If not, asshown in block 10127, the survey status is saved in database 9802. Asshown in block 10128, if a station is switched, then the station TimeStamp timer is stopped and stored in database 9802. As shown in block10130, a determination is made whether a Pop-up question is availablefor a selected station. As shown in block 10132, a determination is madewhether there is a Pop-up question. If not, as shown in block 10140, theselected station is played. If so, as shown in blocks 10134, 10136, and10138, the user can be allowed to view and answer Pop-up questions, theresponses to which are saved in database 9802.

Referring now to FIG. 102, a process 10200 proceeding from point C bywhich a user can participate in a Face-Off Media survey is illustratedand discussed. As shown in block 10202, question set details arerequested and received from database 9802 to check for the traditionalsurvey question type. As shown in block 10204, a determination is madewhether the question set type is Audio/Video. If not, as shown in block10216, the user can be allowed to view the Image file and normalquestions. If yes, as shown in block 10206, the user can be allowed toview the Audio/Video file. As shown in block 10208, a determination ismade whether the Audio/Video file is being played. If not, as shown inblocks 10210 and 10212, if the Next button is not clicked, then theAudio/Video Time Stamping timer is stopped and stored in database 9802.If yes, as shown in block 10219, then the Audio/Video Time Stampingtimer is started in the background. As shown in block 10218, adetermination is made whether the Audio/Video file is paused, stopped,or switched. If so, as shown in block 10220, the Audio/Video TimeStamping timer is stopped and stored in database 9802. As shown in block10222, a determination is made whether there is a Pop-up question. Ifso, as shown in blocks 10224, 10226, and 10228, the user can be allowedto view and answer the Pop-up questions, the responses to which aresaved in database 9802. As shown in blocks 10230, 10232, and 10234, theuser can be allowed to view and answer follow-up questions, theresponses to which are saved, along with the survey status, in database9802.

Referring now to FIG. 103, a process 10300 proceeding from point D bywhich a user can participate in a Weblinks survey is illustrated anddiscussed. As shown in block 10302, the user can be allowed to view awebsite, where question set details are requested and received fromdatabase 9802. As shown in block 10304, a Time Stamping timer forWeblinks is started in the background. As shown in block 10306, the usercan be allowed to click on a button, which can state “I Found It”. Asshown in block 10308, the Time Stamping timer is stopped and stored indatabase 9802. As shown in blocks 10310, 10312, and 10314, the user canbe allowed to view and answer Pop-up questions, the responses to whichare saved in database 9802.

Referring now to FIG. 104, a process 10400 proceeding from point E bywhich a survey is wrapped up is illustrated and discussed. As shown inblock 10402, a determination is made whether there are wrap-upquestions. As shown in blocks 10404, 10406, and 10412, the user can beallowed to view and answer wrap-up questions, the responses to which,along with the survey status, are saved in database 9802. As shown inblock 10408, the user can be allowed to view Preamble Audio/Videorequested and received from database 9802. As shown in block 10410, theuser can be allowed to view a thank-you message requested and receivedfrom database 9802, if there is one.

Referring now to FIG. 105, a process 10500 by which a client can viewsaved survey reports is illustrated and discussed. As shown in block10502, the client can be allowed to view a saved reports list requestedand received from database 9802. As shown in block 10504, the client canbe allowed to click on a saved report. As shown in block 10506, theclient can be allowed to view the saved report, the details of which arerequested and received from database 9802.

Referring now to FIG. 106, a process 10600 by which a client cangenerate a survey report is illustrated and discussed. As shown in block10602, the client views report filters that have been requested andreceived from database 9802. As shown in block 10604, the client choosesfilters for the report. As shown in blocks 10606 and 10608, the clientcan input the report name and save an Enrollment stats report indatabase 9802. As shown in block 10610, the client can view anEnrollment stats report requested and received from database 9802.

Referring now to FIG. 107, a process 10700 by which a client can view aFace-Off survey report is illustrated and discussed. As shown in block10702, the client views survey lists requested and received fromdatabase 9802. As shown in block 10704, the client chooses a survey. Asshown in block 10706, the client views Face-Off lists requested andreceived from database 9802. As shown in block 10708, the client choosesa Face-of list. As shown in block 10710, the client views a Face-Offreport requested and received from database 9802.

Referring now to FIG. 108, a process 10800 by which a client can view aFamiliarity report is illustrated and discussed. As shown in block10802, the client views survey lists requested and received fromdatabase 9802. As shown in block 10804, the client chooses a survey. Asshown in block 10806, the client views a Familiarity report requestedand received from database 9802.

Referring now to FIG. 109, a process 10900 by which a client can view anindividual rater report is illustrated and discussed. As shown in block10902, the client views survey lists requested and received fromdatabase 9802. As shown in block 10904, the client chooses a survey. Asshown in block 10906, the client views media content lists requested andreceived from database 9802. As shown in block 10908, the client choosesmedia content. As shown in block 10910, the client views an Individualrater report requested and received from database 9802.

Referring now to FIG. 110, a process 11000 by which a client can view aMatrix report is illustrated and discussed. As shown in block 11002, theclient views survey lists requested and received from database 9802. Asshown in block 11004, the client chooses a survey. As shown in block11006, the client views media content lists requested and received fromdatabase 9802. As shown in block 11008, the client chooses mediacontent. As shown in block 11010, the client views a Matrix reportrequested and received from database 9802.

Referring now to FIG. 111, a process 11100 by which a client can view aMultiple choice questions report is illustrated and discussed. As shownin block 11102, the client views survey and age group lists requestedand received from database 9802. As shown in block 11104, the clientchooses a survey and one or more age groups. As shown in block 11106,the client views a Multiple choice questions report requested andreceived from database 9802.

Referring now to FIG. 112, a process 11200 by which a client can view aperceptual report is illustrated and discussed. As shown in block 11202,the client views survey, age group, gender, and ethnicities listsrequested and received from database 9802. As shown in block 11204, theclient chooses a survey and one or more age groups, gender, andethnicities. As shown in block 11206, the client views a perceptualreport requested and received from database 9802.

Referring now to FIG. 113, a process 11300 by which a client can view aPopup questions report is illustrated and discussed. As shown in block11302, the client views survey, age group, gender, and ethnicities listsrequested and received from database 9802. As shown in block 11304, theclient chooses a survey. As shown in block 11306, the client views mediacontent lists requested and received from database 9802. As shown inblock 11308, the client chooses a survey and one or more age groups,gender, and ethnicities. As shown in block 11310, the client views aPop-up questions report requested and received from database 9802.

Referring now to FIG. 114, a process 11400 by which a client can view asignup questions report is illustrated and discussed. As shown in block11402, the client views age group, gender, and ethnicities listsrequested and received from database 9802. As shown in block 11404, theclient views a signup questions report requested and received fromdatabase 9802.

Referring now to FIG. 115, a process 11500 by which a client cangenerate and view a traditional report is illustrated and discussed. Asshown in block 11502, a client views report filters requested andreceived from database 9802. As shown in block 11504, the client choosesfilters for the report. As shown in blocks 11506 and 11508, the clientcan input the report name and save a traditional report in database9802. As shown in block 11510, the client can view a traditional reportrequested and received from database 9802.

Referring now to FIG. 116, a process 11600 by which a client can view atrend report is illustrated and discussed. As shown in block 11602, theclient views report filters requested and received from database 9802.As shown in block 11604, the client chooses one or more age groups, andgender. As shown in block 11606, the client views a trend reportrequested and received from database 9802.

Referring now to FIG. 117, a process 11700 by which a client can view aTime Stamping report is illustrated and discussed. As shown in block11702, the client views report filters requested and received fromdatabase 9802. As shown in block 11704, the client chooses a survey andone or more age groups. As shown in block 11706, the client views a TimeStamping report requested and received from database 9802.

Referring now to FIG. 118, a process 11800 by which a client can view aWeblinks testing report is illustrated and discussed. As shown in block11802, the client views survey lists requested and received fromdatabase 9802. As shown in block 11804, the client chooses a survey. Asshown in block 11806, the client views website lists requested andreceived from database 9802. As shown in block 11808, the client choosesa website. As shown in block 11810, the client views a Weblinks testingreport requested and received from database 9802.

Referring now to FIG. 119, a process 11900 by which a user canparticipate in an AMT survey is illustrated and discussed. As shown inblock 11902, a determination is made whether there is StreamingAudio/Video present. If there is, as shown in block 11904, streamingAudio/Video requested and received from database 9802 is played for theuser. As shown in block 11906, the user can be allowed to listen tostreaming media. As shown in block 11908, AMT Audio requested andreceived from database 9802 is played for the user. As shown in block11910, the user is provided with survey questions requested and receivedfrom database 9802. As shown in block 11912, the user can be allowed toanswer media questions. As shown in block 11914, a determination is madewhether there are more media items.

It should be understood that there are many different possible variantsof this inventive concept, all of which are included in the scope ofthis invention disclosure. In fact, the invention disclosure is intendedto comprise a plurality of inventive embodiments, each of which maycomprise some combination of some or all of the elements describedherein (but which may also optionally exclude one or more of theelements generally described herein). If any copyright or trademarkmaterial of an unrelated third party is used in the sample screens shownabove, Applicant contends that this use may be authorized and/or ismerely exemplary (to aid in clarity) and is a de minimis fair use thatdoes not result in any confusion or improper advantage and/or harm tothe owner (especially since this provisional patent application is notintended for publication, but shall be kept secret in the U.S. PatentOffice). It should also be understood that the use of the word“database” is meant to be inclusive of any computer/electronic storagemedia (memory storage) capable of holding electronic data and allowingthe data to be extracted electronically. Thus, a database could bestored on a server, a hard-drive, or internal memory, or it could belocated on a CD, disk, electronic tape, etc. by way of non-exclusiveexample. Likewise, the word “database” is intended to include one ormore separate, independent database(s) (designated for a specific typeof information) and/or a portion of a larger database (that may bepartitioned into several smaller database tables). Thus, the term“database” as used herein is inclusive of a table in a database (whichmay include several such tables). Also, the computer system could be adesignated specific purpose machine designed to include specificphysical components and to perform the process tasks, or it could be ageneral purpose computer machine programmed to be configured to performthe process tasks. In such case, the program/software may be stored oncomputer readable media, which is then operable to transform the generalpurpose computer machine into a specific purpose machine that performsas discussed above.

While various embodiments in accordance with the principles disclosedherein have been shown and described above, modifications thereof may bemade by one skilled in the art without departing from the spirit and theteachings of the disclosure. The embodiments described herein arerepresentative only and are not intended to be limiting. Manyvariations, combinations, and modifications are possible and are withinthe scope of the disclosure. Alternative embodiments that result fromcombining, integrating, and/or omitting features of the embodiment(s)are also within the scope of the disclosure. Accordingly, the scope ofprotection is not limited by the description set out above, but isdefined by the claims which follow, that scope including all equivalentsof the subject matter of the claims. Each and every claim isincorporated as further disclosure into the specification and the claimsare embodiment(s) of the present invention(s). Furthermore, anyadvantages and features described above may relate to specificembodiments, but shall not limit the application of such issued claimsto processes and structures accomplishing any or all of the aboveadvantages or having any or all of the above features.

Additionally, the section headings used herein are provided forconsistency with the suggestions under 37 C.F.R. 1.77 or to otherwiseprovide organizational cues. These headings shall not limit orcharacterize the invention(s) set out in any claims that may issue fromthis disclosure. Specifically and by way of example, although theheadings refer to a “Field of Invention,” the claims should not belimited by the language chosen under this heading to describe theso-called field. Further, a description of a technology in the“Background” is not to be construed as an admission that certaintechnology is prior art to any invention(s) in this disclosure. Neitheris the “Summary” to be considered as a limiting characterization of theinvention(s) set forth in issued claims. Furthermore, any reference inthis disclosure to “invention”, “software”, etc. in the singular shouldnot be used to argue that there is only a single point of novelty inthis disclosure. Multiple inventions may be set forth according to thelimitations of the multiple claims issuing from this disclosure, andsuch claims accordingly define the invention(s), and their equivalents,that are protected thereby. In all instances, the scope of the ultimateclaims shall be considered on their own merits in light of thisdisclosure, but should not be constrained by the headings set forthherein.

Use of broader terms such as “comprises,” “includes,” and “having”should be understood to provide support for narrower terms such as“consisting of,” “consisting essentially of,” and “comprisedsubstantially of” Use of the term “optionally” and the like with respectto any element of an embodiment means that the element is not required,or alternatively, the element is required, both alternatives beingwithin the scope of the embodiment(s).

What is claimed is:
 1. A method comprising: streaming a media item froma hosting server to a participant device; receiving, at the hostingserver from the participant device, time-stamp information indicating aninteraction time associated with a participant interaction with themedia item; in response to receiving the time-stamp information:determining, from the time-stamp information, a consumed portion of themedia item, the consumed portion of the media item corresponding to aportion of the media item streamed to the participant device prior tothe interaction time; determining, based on the consumed portion of themedia item, whether to transmit survey content to the participantdevice; and in response to determining that survey content is to bepresented, transmitting the survey content to the participant device. 2.The method of claim 1, wherein the participant interaction with themedia item includes: a participant making a selection to at leasttemporarily stop playback of the media item.
 3. The method of claim 1,further comprising: determining a time between start and stop actions;and determining whether the time between start and stop actionssatisfies a threshold pop-up percentage.
 4. The method of claim 3,further comprising: transmitting first survey content in response todetermining that the threshold pop-up percentage has not been satisfied.5. The method of claim 4, further comprising: transmitting second surveycontent, different from the first survey content, in response todetermining that the threshold pop-up percentage has been satisfied. 6.The method of claim 1, further comprising: streaming a plurality ofmedia item from the hosting server to the participant device; receiving,at the hosting server from the participant device, a plurality oftime-stamp information indicating interaction times associated withparticipant interactions with each of the plurality of media items;obtaining a plurality of pop-up percentages applicable to individualmedia items of the plurality of media items; making a determination, foreach of the plurality of media items, whether a consumed portionsatisfies a corresponding pop-up percentage; and transmitting surveycontent to the participant device in accordance with the determination.7. The method of claim 1, wherein: the time-stamp information includes atime stamp representing an elapsed time between presentation of adesignated portion of the media item and occurrence of an eventassociated with the participant device.
 8. A hosting server comprising:a processor; a memory coupled to the processor and configured to store aprogram of instructions executed by the processor; a communicationsinterface coupled to the processor and configured to work in cooperationwith the processor to communicate with a participant device via acommunications network; the processor configured to: stream a media itemto the participant device; receive, from the participant device,time-stamp information indicating an interaction time associated with aparticipant interaction with the media item; in response to receivingthe time-stamp information: determine, from the time-stamp information,a consumed portion of the media item, the consumed portion of the mediaitem corresponding to a portion of the media item streamed to theparticipant device prior to the interaction time; determine, based onthe consumed portion of the media item, whether to transmit surveycontent to the participant device; and in response to determining thatsurvey content is to be presented, transmit the survey content to theparticipant device.
 9. The hosting server of claim 8, wherein theparticipant interaction with the media item includes: a participantmaking a selection to at least temporarily stop playback of the mediaitem.
 10. The hosting server of claim 8, the processor furtherconfigured to: determine a time between start and stop actions; anddetermine whether the time between start and stop actions satisfies athreshold pop-up percentage.
 11. The hosting server of claim 10, theprocessor further configured to: transmit first survey content inresponse to determining that the threshold pop-up percentage has notbeen satisfied.
 12. The hosting server of claim 11, the processorfurther configured to: display second survey content, different from thefirst survey content, in response to determining that the thresholdpop-up percentage has been satisfied.
 13. The hosting server of claim 8,the processor further configured to: stream a plurality of media itemfrom the hosting server to the participant device; receive, at thehosting server from the participant device, a plurality of time-stampinformation indicating interaction times associated with participantinteractions with each of the plurality of media items; obtain aplurality of pop-up percentages applicable to individual media items ofthe plurality of media items; make a determination, for each of theplurality of media items, whether a consumed portion satisfies acorresponding pop-up percentage; and transmit survey content to theparticipant device in accordance with the determination.
 14. The hostingserver of claim 8, wherein: the time-stamp information includes a timestamp representing an elapsed time between presentation of a designatedportion of the media item and occurrence of an event associated with theparticipant device.
 15. A system comprising: a hosting server includinga processor and associated memory; a participant device, including aprocessor and associated memory, the participant device coupled to thehosting server via a communications network; the participant deviceconfigured to execute a survey provided by the hosting server, whereinexecuting the survey includes: generating time-stamp informationassociated with participant interactions with the survey; transmittingthe time-stamp information to the hosting server the hosting serverconfigured to: stream a media item from to the participant device;receive, from the participant device, time-stamp information indicatingan interaction time associated with a participant interaction with themedia item; in response to receiving the time-stamp information:determine, from the time-stamp information, a consumed portion of themedia item, the consumed portion of the media item corresponding to aportion of the media item streamed to the participant device prior tothe interaction time; determine, based on the consumed portion of themedia item, whether to transmit survey content to the participantdevice; and in response to determining that survey content is to bepresented, transmit the survey content to the participant device. 16.The system of claim 15, wherein the participant interaction with themedia item includes: a participant making a selection to at leasttemporarily stop playback of the media item.
 17. The system of claim 15,the hosting server further configured to: determine whether a timebetween start and stop actions satisfies a threshold pop-up percentage.18. The system of claim 17, the hosting server further configured to:transmit first survey content in response to determining that thethreshold pop-up percentage has not been satisfied.
 19. The system ofclaim 18, the hosting server further configured to: display secondsurvey content, different from the first survey content, in response todetermining that the threshold pop-up percentage has been satisfied. 20.The system of claim 15, the hosting server further configured to: streama plurality of media item from the hosting server to the participantdevice; receive, at the hosting server from the participant device, aplurality of time-stamp information indicating interaction timesassociated with participant interactions with each of the plurality ofmedia items; obtain a plurality of pop-up percentages applicable toindividual media items of the plurality of media items; make adetermination, for each of the plurality of media items, whether aconsumed portion satisfies a corresponding pop-up percentage; andtransmit survey content to the participant device in accordance with thedetermination.